ASYMPTOTIC EXPANSION FOR INVERSE MOMENTS OF 
BINOMIAL AND POISSON DISTRIBUTIONS 

MARKO ZNIDARIC 

Abstract. An asymptotic expansion for inverse moments of positive bino- 
mial and Poisson distributions is derived. The expansion coefficients of the 
asymptotic series are given by the positive central moments of the distribu- 
tion. Compared to previous results, a single expansion formula covers all (also 
non-integer) inverse moments. In addition, the approach can be generalized 
to other positive distributions. 



1. Introduction 

Inverse moments of probability distributions can arise in several contexts. In 
particular, they are relevant in various statistical applications, see e. g. Grab and 
Savage J.., Mendenhall and Lehman [II], Jones and Zhigljavsky and references 
therein. Recently it has been shown |16| that the first two inverse moments of 
positive binomial distribution are needed for the calculation of the running time of 
a particular quantum adiabatic algorithm solving 3-SAT problem. Because closed 
expressions are usually not possible it is of interest to derive asymptotic expansions. 

In the present paper we are going to study the inverse moments of positive 
binomial and Poisson distributions. For binomial distribution, 

(1.1) P(x = i) = r ^(^)p i q n - i , i = l,...,n 
with q = 1 — p, the r-th inverse moment is given by 

(1.2) fr(n) = (1 - q n )E(l/x r ) = £ ("W-I. 
Similarly, for Poisson distribution the r-th moment g r is 

(1.3) * = £ e - m!! i4- 

* — ' SI s r 

s — 1 

We are going to derive an asymptotic expansion of f r (n) and g r in terms of inverse 
powers of (np + q) or (m + 1) for binomial and Poisson distribution, respectively. 
The expansions work for arbitrary real and positive r. We will also generalize the 
result to arbitrary positive distributions. The expansion coefficients are given by 
the central moments of the distribution in question which is intuitively appealing 
result. Namely, for sufficiently sharp distribution the inverse moment will be ap- 
proximately given by the inverse of the average value, i.e. E(l/x r ) ~ 1/E(x) r . If 
the distribution is non-zero at a single point, then this result is exact. Higher orders 
in the asymptotic expansion should therefore "measure" how much the distribution 



2000 Mathematics Subject Classification. Primary 62E20 60E05. 



2 



MARKO ZNIDARIC 



in question differs from a point distribution, P(x = i) = 5i t w x \. This is the reason 
why it is natural that the expansion is given in terms of central moments. But let 
us first briefly review known results about inverse moments. 

The problem of calculating the inverse moments of positive distributions, e. g. 
f r {n) or g r , has a rather long history. Already in 1945 Stephan ^1] studied the 
first and second inverse moment for binomial distribution. Grab and Savage 
calculated tables of reciprocals for binomial and Poisson distributions as well as 
derive a recurrence relation. They also derived an exact expression for the first 
inverse moment for a Poisson distribution involving an exponential integral. David 
and Johnson 0] used an approximating formula for binomial distribution in terms 
of inverse powers of (np). Govindarajulu 6 obtained a recursive formula for in- 
verse moments of binomial distribution. The recurrence formula though is rather 
complicated as it involves recursion in n as well as in the power of the moment r. 
Asymptotic expansions have also been studied. Such expansions are of value also 
because the formal definitions of f r (n) i|1.2fl or g r l|1.3f) are not simple to evaluate 
for large values of np or m. One has to sum many terms, each being a product 
of a very small and a very large number, all together resulting in a small inverse 
moment. Tiku |15j derived an asymptotic expansion of g r using Laguerre poly- 
nomials. Chao and Strawderman j^j considered slightly different inverse moments 
defined as E(l/(x + a) r ) which are frequently easier to calculate. Simple expression 
for integer a > 1 and r = 1 are derived. Kabe derived a general series with the 
expansion coefficients given by positive factorial moments /z^ = E(a;!/(a; — of 
the distribution. He also derived a general formula 



where M(i) is a moment generating function, M(t) = E(e tx ) = 53fc=o Mj^/i' with 
Uj = E(x- 7 ). For further discussion of negative moments and generating functions 
see also Cressie et.al. Various other identities involving generating functions 
are derived in Rockower |18| . Equation 11.41 will serve as a starting point for our 
derivation. Quite recently the asymptotic expansions of the first inverse moment 
for binomial distribution have been considered by Marciniak and Wesolowski ^U] 
and by Rempala ■ In HE! an expansion in terms of Euler polynomials is given 
while in J2| a more elegant expansion in terms of inverses of = nl/(n — j)\ is 
presented. In both works only the expansion of the first moment is given. Jones 
and Zhigljavsky [Sj gave a general method using Stirling numbers to derive the 
asymptotic expansion for Poisson distribution for an arbitrary real power r. The 
expansion though gets more complicated for larger r. 

In the present work we are going to systematically derive a general asymptotic 
expansions of f r (n) and g r for an arbitrary real power r. What is more, the ex- 
pansion for an arbitrary r will be given by a single simple formula. The paper is 
organized as follows. In section we derive asymptotic expansion for binomial dis- 
tribution. In section a similar result is derived for Poisson distribution. Finally, 
in section 01 the method is generalized to arbitrary positive distributions. 



ASYMPTOTIC EXPANSION FOR INVERSE MOMENTS OF DISTRIBUTIONS 



3 



2. Asymptotic Expansion for Binomial Distribution 

Note that for integer r the inverse moment f r (n) can be formally written in 
terms of a generalized hypergeometric function £Q , 



fi(n) = npq n 1 2 F 3 



(2.1) / 2 (n) = npq™- 1 ^ 



1,1,1- n p^ 
2,2 '~q, 
1,1,1,1-n p" 
2,2,2 ' 

and analogously for larger r's. Although exact, these expressions are not very 
illuminating. In fact, using a series expansion, e.g. 

/ 00 n tp f a,b,c \ _ ^ (a) k (b)k(c)k z k 

(2 - 2) 2F3 {d,g ' Z )-^ (d) k (g) k W 

where (a)k = T(a + k)/T(a) is the Pochhammer symbol, one can see that the 
corresponding series for a generalized hypergeometric function in equation 12.11 is 
nothing but the sum occurring in the average for f r (n) (|1.2fl . 

Our approach will be different. First we write f r (n) as an integral. Using identity 
J °° x p e~ rx dx = F< fp+i > ' i with T(p + 1) = p\ for integer p, and binomial expansion 
of (q + pe~ x ) n we quickly see that f r (n) l|1.2|) is given by 

1 f°° 

(2.3) f r (n) = — / tT- 1 [(q+pe-*T ~ l] dx. 

r(r) Jo 

This is nothing but a special case of equation 11.41 Integrating once per parts we 
get 

(2.4) f r{n ) = ^P x r e- x (q + pe- x r- l dx. 

r(r + l) J 

The last equation will serve as a starting point for the asymptotic expansion. Before 
proceeding though, let us prove two auxiliary Lemmas about central moments. 

Lemma 1. Let M(t) be generating function of probability distribution, 

CO j» 

(2-5) M(t) = ^' k - 

k=0 

where fi' k := E(x k ) is k-th moment about origin. Then the generating function F(t) 
of central moments, i.e. 

oo ,k 

(2.6) F (*)=E^fc!> Mfc:=E((^-S) fc ), 

k=0 

with x = K(x) being the mean, is given by 

(2.7) F{t) = e~ ts M(t). 
Proof. Lemma is proved by straightforward expansion, 

OO OC ,1 ,u 

(2.8) n*) = ££(-*) V E (*V 

k=0 1=0 

Rewriting summation in terms of j — l + k and I and recognizing binomial expansion 
of (x-xY, wegetF(i)=£fc MVi!- □ 
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In the special case of binomial distribution Lemma Ogives the following result. 

Corollary 1. For the binomial distribution generating function F n (t) of central 
moments is, 

(2.9) F n (i) = («e-* + pe* , ) n , 

where central moments are , 



(2.10) fi k (n) = ("W - n P ) 



i=0 



Proof. Generating function for binomial distribution is M n {t) = (g+pe*) n and the 
mean is x — - np. Using Lemma ^hnmediately gives the result. □ 

The first few central moments of binomial distribution are readily calculated and 
are 

(2.11) n (n) = 1, Mi(ra) = 0, fj, 2 (n) = np(l - p), 

Hsin) = np(l — p)(l — 2p), Hi{n) = np(l — p)(l — 6p + 6p 2 + 3np — 3np 2 ). 
Higher moments can be calculated using the following Lemma. 

Lemma 2. For central moments of binomial distribution /ife(n) $2.1(l\) the following 
recursive relation holds: 

(2.12) f M k+1 (n)=p(l-p) {^j^ +n*/i fc _i(n) 

where /^(n) is considered as a function of p only (q is replaced by 1 — p). 

Proof. The relation is derived by differentiating definition of Hk( n ) (|2.10(1 with 
respect to p. Using identity 

(2.13) ( n j ]p i( l n ^ i ( i - n P) k = W+lW + n P fj, k (n), 

obtained by writing fik+i( n ) = Y17=o COp*^™ - ^* — np) k (i — np), one obtains the 
recursive relation l|2.12|l . □ 

Corollary 2. Using Lemma\^we can show that 

(1) fik{n) is polynomial of order k in p 

(2) /ifc(n) is polynomial of order |_f J in n 

(3) Leading order in n of ^2k(n) is fJ,2k(n) = (2k — \)\\(pqn) k + C(n fc_1 ). 

Proof. Using induction and recursive relation (|2.12|) . together with the initial con- 
dition fJ-i(n) = and /J>2(n) = np(l —p), we can see that the order of polynomial 
fjLk(n) in p is indeed k. Similarly, the order in n of /Zfc+i(n) is by 1 larger than that 
of /ifc_i(ri), therefore /ifc(n) ~ 0(n^l). Specifically, one can see that the leading 
order in fi 2 k(n) is fi2k(n) ~ (pq) k (2k - l)lln k . □ 

Now we are ready to give the asymptotic expansion of f r (n) (|1.2(l . 



^Note that in the definition of fik( n ) the sum runs over i = 0, . . . ,n, that is including i = 0, 
which term is for instance excluded in the definition of f r (n) 11.21 . 
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Theorem 1. For any real r > inverse moment fr(n) 11. fy) is given by asymptotic 
expansion 

The terms /ifc(n — l)/(np + q) k are of order ©(l/n^il ), where \x] is the smallest 
integer larger than x. For non-integer r's the binomial symbol is understood as 
( r + k ) = ( r + i)(r + 2)...(r + fc)/fc!. 

Proof. Writing (q+pe~ x ) n ~ 1 = e~ xp ( n ~ x > (qe xp +pe~ xq ) n ~ 1 in integral equation for 
f r (n) l|2.4[l . changing the integration variable to y = x(np + g), we get 

(2.15) f r (n) = n l f7e-^ n -i ( V — ) dy. 

rl{np + q) r + l Jo \ np + qj 

Using expansion of F n (y) l|2.9|) in terms of central moments we get after integration 
the result 1|2.14[1 . From Corollary[2]it follows that /Zfc(n.— 1) is of the order ©(nW) 
and so the fc-th term in the expansion is fik(n — 1) / (np + q) k ~ ©(l/n^l), showing 
that the expansion is indeed asymptotic in n. □ 

It is instructive to explicitly write out f r (n) (|2.14(l using first few lowest terms. 
We have 

f(\ np (^ i (^ + 2)(r + l)(n-l)pg f 1 ( r + 3)(g-p), 

(2.16) f r (n) = 1 + — 1- 



(np + q) r+1 \ 2(np + q) 2 \ 3(np + q) 

(r + 4)(r + 3)(1 - 6pq + 3npq) 
12(np + q) 2 

Because in the literature expansions in terms of inverse powers of np are frequently 
given, instead of (np + q) as here, we will write expansion in terms of (np), obtained 
from (f2~T^ by using 1/(1 + x) k = (-x)i ( k ^ j )- 

Corollary 3. f r (ri) expanded in terms of inverse powers of (np) is 

1 / r(r + l)g r(r + l)(r + 2)g(4 + g + 3rg) 

(2 - 17) = + + + ' 

Specifically, for lowest three integer r 's we have 

rom tr^ x q i + i g(l + 4g + g 2 ) 
(2.18) / x (n) = — 1+7 — r + -7 — + ; — ^ + 

np \ (np) (np) z (np) 3 

+ g(l + g)(l + 10g + g 2 ) + g(l + 26g + 66g 2 + 26g 3 + g 4 ) 
(np) 4 (np) 5 



(2.19) / 2 (n) 



(np) 2 



3g g(4 + 7g) 5g(l + 6g + 3g 2 ) 



(np) (np) 2 



(np) 3 

g(6 + 91g+146g 2 + 31g 3 
(np) 4 
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(2.20) / 3 (n)= * (V ^ ■ 5 ^ + 5 ^ ■ ^(1 + 8, + 6^) 



(np) 3 \ (np) (np) 2 (np) 3 

7g(3 + 58<? + 128<? 2 + 43g 3 ) 

+ 

3. Asymptotic Expansion for Poisson Distribution 

For Poisson distribution the whole approach is very similar to the one for bino- 
mial distribution so we will state the main Theorem right away. 

Theorem 2. For any real r > the inverse moment g r of Poisson distribution 
11.31) is given by the asymptotic expansion 

//it (r + k 



(3.1) gr = " V (-1)*^* + 0(l/m^) 
y ' y (m + l) r+1 1^ ' (m + \) k \ r J w ' 

where jl^ are central moments of Poisson distribution, 

oo s 

(3.2) ^^e-^s-m)*. 



s=0 



Proof. The proof essentially goes along the same steps as the one for Theorem ^ 
First note that Eq. 12.41 can be for any distribution written as 

(3.3) (1 - P(s = 0))E(l/ a -) = £ P(.)l = jp^^d*. 

where M(x) is generating function of the distribution, e.g., it is M(x) = (q+pe x ) n 
for binomial and M(x) = e™''^ 1 ' for Poisson distribution. Now we try to write 
derivative of generating function in terms of generating function of the central 
moments F(x). For arbitrary distribution F(x) is given by F(x) = e~ xE ^ M(x), see 
Lemma^ The "trick" is now to write dM/dx as a(x)F(x), with some distribution 
dependent a(x). We can see that a(x) must be given by logarithmic derivative of 
generating function, a(x) = e xE ^ x ' 4- (log M (x)) . Using a(x) the inverse moment is 
then 

(3.4) (1 - P(s = 0))E(l/x r ) = [°°x r a(-x)F(-x)dx. 

r(r + l) Jo 

For Poisson distribution we have a(x) — me 1 ^ 1 ', from which by substitution of 
variables y = (in + l)x an expansion parameter (m + 1) is obtained. Furthermore, 
after writing series expansion for F(—x) the resulting integrals L y p e~ y dy are 
easily evaluated, giving final result l|3.1() . □ 

From the proof we see that the asymptotic expansion works for distributions 
having simple a(x) (e.g. exponential), so that integrals J °° x p a(x)dx can be an- 
alytically evaluated. Central moments of Poisson distribution can be calculated 
using the following recursive relation. 
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Lemma 3. Central moments of Poisson distribution are given by recursive formula 



(3.5) p, k+ i = m + kftk- 
with the first few being 

(3.6) fiQ = 1, fii = 0, /X2 = rn, £13 = m, £14 = m + 3m 2 . 

Proof. The proof goes along the same line as the one for Lemma [5] □ 

Using Lemma [3] and Theorem [21 we can derive first few terms in the expansion 
of g r . 



(3 . 7) 9r = ±S 1 + ±±V + rJ™± ^ + y j±fl + 0(1/< 



Corollary 4. Firs£ /ew ierm m £/ie expansion of g r in inverse powers of m are 

r + 1) r(10 + 21r + 14 
m' I 2m 24m 2 



4. General positive distributions 

Already in proof of Theorem [21 we saw that the asymptotic expansion can be 
derived for general distributions. Here we state the Theorem. 

Theorem 3. Let Mix) be generating function of positive moments (about origin) 
for an arbitrary distribution and let fik denote its central moments. That is, if 
x = E(x) then /i^ = E((x — x) k ). If we denote by <j>{x) the characteristic function, 
4>(x) — logM(x), i.e. the generating function of cumulants, then the asymptotic 
expansion of inverse moments is in general given by 



oo 1 / 00 

s=l \fc=0 



( 4.i.) >;H^- = -(>:^^i f>w(-y/# 







The above series must be understood as an asymptotic expansion in 1/x. 

Proof. The proof goes along the same line as the one for Theorem [21 One can start 
with ea uat ion 13 . 41 and after changing the integration variable to y = xx one arrives 
at equation 14. II □ 

Note that expansion (|4.1|) works exactly when the asymptotic expansion makes 
sense, that is when e. g. the first inverse moment is given in the leading order by the 
inverse of the expectation value, 1/x. This happens when higher central moments 
grow with the mean x sufficiently slowly, for instance the second central moment 
as fi2 x x 2 ~ s with S > 0, see also discussion in [5]. In the case of binomial and 
Poisson distributions one has ~ ajW ; ensuring asymptoticity of the expansion. 
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